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PREFACE 


This  Memorandum  is  another  in  the  series  of  RAND  studies  concerned 
vitn  predicting  demands  for  spare  parts.  Our  objective  has  been  to 
determine  empirically  whether  exponential  smoothing  techniques  can 
predict  demands  more  accurately  than  the  moving  average  techniques 
currertly  being  used  in  th°  Air  Force.  We  applied  various  forms  of 
these  two  types  of  prediction  _'<"ocedures  to  three  sets  of  historical 
data: 

1)  Base  demands  for  Hi-Valu  am'  Category  Tl-R  items  for  the  B-52, 

2)  Components  of  the  Falcon  missx _ ,  «nd 

3)  Depot  issues  f  r  low  cost  Category  Ill  it  ms  on  the  B-52, 

The  Navy  and  some  industrial  firms  are  already  using  exponential 

smoothing  techniques.  We  have  undertaken  this  study  to  examine  the 
possible  usefulness  of  these  techniques  to  the  Air  Force.  Personnel 
who  are  concerned  with  predicting  the  demand  for  spare  parts  should  he 
especially  interested  in  exponential  smoothing  methods. 
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SUMMARY 


This  Memorandum,  a  comparative  study  of  techniques  for  predicting 
the  demand  for  spare  parts,  attempted  to  discover  the  potential  ad¬ 
vantages  which  exponential  smoothing  has  over  the  moving  average 
procedures  the  Mr  Force  is  now  using. 

In  exponential  smoothing  the  predicted  average  is  found  fcy  weight¬ 
ing  the  iverage  computed  at  the  end  of  the  last  time  period  with  the 
observed  demand  during  the  current  period.  One  may  vary  the  weighting 
constant  on  the  basis  of  how  much  weight  one  wants  to  put  on  the  last 
average . 

Various  forms  of  exponential  smoothing  and  averaging  were  applied 
to  three  sample  sets  of  de+’a:  Hl-Valu  and  Category  II  recoverable  B-52 
parts,  components  of  the  Falcon  missile,  and  Category  III  depot  issues 
of  B-52  items.  To  the  usual  methods  for  selecting  preferred  techniques 
used  in  previous  studies  we  added  a  loss  function,  an  aggregate  measure 
of  accuracy  which  balances  procurement  costs  against  holding  costs. 

Die  study  led  to  the  following  findings  and  conclusions: 

(1)  For  any  of  the  three  sets  of  data,  exponential  smoothing  was 
not  a  significantly  better  prediction  technique  than  the  cumulative 
issue  rate  procedures  now  being  used  in  the  Air  Force.  Nevertheless, 
it  does  have  definite  computational  advantages  which  may  be  valuable . 

In  first  order  smoothing  only  one  average  need  be  stored  for  each  item. 
The  rate  of  response  due  to  the  smoothing  constant  can  be  easily  changed, 
and  trends  can  also  be  accommodated  readily. 

(2)  A  measure  of  aggregate  loss,  such  as  the  loss  function  intro¬ 
duced  in  this  study,  should  be  used  to  select  preferred  smoothing 


techniques.  The  ranking  procedures  used  in  earlier  studies  (as  well 
as  in  this  one)  do  not  always  serve  to  discriminate  among  techniques. 
More  important,  they  ignore  the  magnitude  of  the  errors. 

(3)  The  use  of  program  element  information  for  the  Falcon  com¬ 
ponents  improved  the  accuracy  of  our  predictions;  application  of 
requisition  data,  which  was  available  for  the  Category  III  items,  did 
not. 

(4)  With  any  of  the  techniques  applied  to  the  Category  III  Items, 
prediction  accuracy  did  not  increase  substantially  when  the  base  period 
was  made  longer  than  one  year. 
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I .  INTRODUCTION 


PURPOSE  AND  SCOPE 

This  Memorandum  is  one  of  a  continuing  series  on  the  prediction 
of  demand  for  spare  parts,  a  subject  which  is  a  perennial  one  in 
Logistics.  Our  scope  here  does  not  involve  testing  a  complete  inven¬ 
tory  policy.  Rather,  we  are  restricting  ourselv  s  to  the  simpler 
question  of  prediction  accuracy. 

We  have  chosen  such  a  limited  objective  for  two  reasons.  In  the 
first  place,  exponential  smoothing  is  a  special  case  of  a  general  class 
of  prediction  techniques  the  peculiar  properties  of  which  make  it  a 
convenient  technique  for  application.  Secondly,  it  is  currently  being 
used  by  the  Navy  and  some  industrial  firms,  and  we  feel  that  the  Air 
Force  should  be  interested  in  the  evaluation  of  a  prediction  technique 
that  other  users  have  found  simple  and  successful. 

OUTLINE  OF  THE  STUDY 

In  Section  II  we  present  a  general  discussion  of  the  problem  of 
predicting  spares  demand.  Section  III  describes  the  moving  average 
and  exponential  smoothing  techniques.  Two  fundamentally  diffe. ent 
sets  of  data  were  employed.  The  first  set  of  data, from  two  bases  on 
272  B-52  items  and  27  Ffclcon  recoverable  parts,  is  introduced  in 
Section  IV;  the  test  design  for  this  data  is  found  in  Section  V. 

Section  VI  deals  with  measures  of  accuracy,  and  Section  VII  presents 
results.  In  Section  VIII,  the  second  set  of  data,  covering  ten  quarters 
of  depot  Issues  for  425  Category  III  items,  is  described  and  results 
are  given.  Section  IX  develops  a  method  of  measuring  error  for  an 
aggregation  of  items;  this  method  Is  then  used  to  evaluate  prediction 


2 


techniques  for  the  Category  III  items.  Findings  and  conclusions 
constitute  Section  X. 


3 


II.  PROBLEM  OF  PREDICTING  SPARES  DEMAND 

ASSUMPTIONS 

We  do  not  pretend  to  offer  an  exhaustive  discussion  of  the  prob¬ 
lem  of  predicting  spares  demand.  Instead,  making  several  assumptions 
about  the  reed  world,  we  shall  define  and  turn  our  attention  to  one 
specific  problem.  We  will  define  demand  and  specify  the  form  of  the 

demand  data.  Then  we  shall  discuss  some  of  the  relevant  consider- 

* 

ations  in  demand  prediction  that  influence  our  reseeirch  design. 

Definition  of  Demand 

We  are  Interested  only  in  "recurring"  demand  for  spare  parts, 
i.e.,  all  except  one-time  demands,  such  as  technical  order  compliance 
demands  where  a  modified  part  is  substituted  for  an  Inferior  but 
serviceable  one.  In  the  recoverable  parts  area,  the  definition  of 
demand  is  further  restricted  to  exclude  a  demand  made  on  the  supply 
system  if  the  bench  check  showB  that  the  reparable  turn-in  is  service¬ 
able.  The  definition  of  a  demand  for  a  recoverable  spare  part  is  thus 
identical  with  the  Air  Force  definition  of  a  maintenance  replacement 
removal  (MRR). 

Demand  Data 

We  shall  limit  our  i  terest  to  problems  in  vhich  the  demand  data 
is  summary  information  specifying  total  demand  for  each  period  by  line 
item.  In  the  language  of  the  mathematician  we  have  a  time  series  of 

"  # 

Seme  of  the  relevant  ideas  are  also  discussed  in  A  Comparative 
Study  of  Prediction  Techniques,  by  Max  Astrakhan,  Bernice  Brown,  and 
J.  W.  Bought en,  The  RAND  Corporation,  RM-2811,  December,  1961. 


k 


* 

demand.  Initial  estimates  may  or  nay  not  be  available.  In  acme 
casea  the  demand  data  may  also  Include  a  time  series  of  requisition 
data,  e.g.  the  total  nuaiber  of  demands  and  the  total  nusber  of  requi¬ 
sitions  used  in  making  the  demands  by  quarter  and  item. 

Program  Element  )UJSa 

Auxiliary  data  such  as  the  flying  hours  per  month  may  be  on  hand. 
In  Air  Force  demand  prediction  i  roblears  a  variety  of  program  elements 
has  been  examined,  including  sorties,  lev-level  flying  hours,  and 

’ll# 

equipment  hours.  The  objective  is  alvays  to  find  some  program  ele¬ 
ment  or  elements  that  will  transform  the  original  time  series  of  data 
into  a  new  series  of  data  from  which  more  accurate  predictions  can  be 
made. 

Probability  distribution  of  Demand 

We  shall  not  make  any  assumption  about  the  "true"  probability 
distribution  of  damand  nor  shall  va  restrict  ourselves  to  stationary 

jimm 

demand. 

Objective  of  Demand  Prediction 

Our  objective  la  to  find  a  technique  that  will  predict  demand 
moat  accurately  over  a  reasonably  long  period  of  time,  such  as  pro¬ 
curement  leadtime  —  e.g.  nine  months  or  a  year.  These  predictions 

*In  the  event  that  initial  estimates  and  demand  data  are  both 
available,  one  technique  for  combining  them  is  suggested  in  W.  H. 
McGlothlin,  Development  of  Bayesian  Parameters  for  fjare  Parts  Demand 
Prediction,  The  rAnD  Corporation,  RM-3&99,  July,  19o3* ** 

**See  ii.  3.  Campbell,  The  Relationship  of  Resource  Demand  to 
Airbase  Operations,  The  RAND  Corporation,  RM-3^2tt-PR,  January  1963* 

If  demand  la  stationary  the  minimus  variance  estimate  of  mean 
demand  Is  obtained  by  weighting  all  past  data  equally. 
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cannot  be  translated  directly  Into  procurement  actions  because  safety 
levels  vould  have  to  be  added  for  demand  and  leadtime  variations. 

OEHERAL  CONSIDERATIONS 

We  have  defined  the  problem  above.  Let  us  examine  here  the 
rationale  for  our  choice  of  problem.  We  assumed  a  time  series  of 
summary  data,  because  this  is  the  sort  most  commonly  encountered. 

We  set  an  objective  of  predicting  demand  over  a  procurement  leadtime 
so  that  the  prediction  errors  could  be  computed.  In  contrast,  a 
prediction  of  average  demand  plus  a  safety  level,  though  appropriate 
for  procurement,  vould  bias  the  error  distribution.  Furthermore,  the 
safety  level  is  an  additive  to  the  average  demand  and  can  be  considered 
separately. 

Once  one  has  selected  the  objective  of  predicting  demand  over  a 
procurement  leadtime,  it  la  not  necessary  to  assvne  a  specific  proba¬ 
bility  distribution.  In  statistical  terns,  the  estimation  of  the 
mean  value  does  not  require  that  ve  know  the  form  of  ttt  probability 
distribution.  Furthermore,  ve  have  good  reasons  to  uvold  the  selection 
of  a  specific  probability  distribution.  In  the  first  place,  ve  are 
Interested  in  the  prediction  of  demand  at  different  echelons  including 
base  and  depot.  Variance  of  demand  at  each  e'iielon  is  strongly  influ¬ 
enced  by  the  requisitioning  policies  at  lover  echelons.  For  example, 
if  bases  order  a  year's  supply  of  an  item  Instead  of  a  quarter's  worth, 
the  variance  of  demand  on  the  depot  vlll  be  Increased.  If  one  proba¬ 
bility  distribution  vere  to  suffice  for  all  echelons,  it  would  be 
essential  that  the  distribution  have  at  least  tvo  parameters  —  to 
provide  for  different  means  and  variances  by  line  item.  Secondly,  ve 


6 


tellers  ttet  a  demand  prediction  technique  should  t?  sensitive  to  slow 
changes  In  the  mean  demand  rate.  In  other  words,  our  examination  of 
data  leads  us  to  believe  that  items  show  non^stationary  demand  charac¬ 
teristics  that  should  not  be  neglected.  The  estimation  of  parameters 
for  a  two-parameter  non-statlonary  probability  distribution,  however. 
Is  a  formidable  task. 
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III,  PREDICTION  TECHNIQUES 


BACKGROUND 

The  current  USAF  procedure  for  confuting  the  "historical  usage 
rate"  element  of  the  requirements  computation  at  both  the  base  and 
the  depot  levels  is  essentially  an  unweighted  moving  average  which  is 
updated  periodically.  Such  averages  have  many  of  the  desirable  charac¬ 
teristics  of  a  practical  method  for  smoothing  out  the  fluctuations  in 
a  demand  his  tor;'  to  get  an  estimate  of  the  expected  demand  rate.  They 
have  a  stable  response  to  changes,  and  the  rate  of  response  can  be 
controlled  by  the  number  of  months  (or  observations)  included  in  the 
average.  Although  moving  averages  are  simple  to  confute,  they  require 
that  the  individual  observations  used  in  confuting  be  retained  so  that 
new  information  can  be  added  and  old  information  dropped.  Exponential 
smoothing  or  exponential  weighting  is  similar  to  a  moving  average,  ex¬ 
cept  that  all  observations  are  used.  The  former,  however,  does  not 
require  the  keeping  of  a  long  historical  record  in  the  active  file  or 
coofuter,  and  the  data-processing  requirements  are  therefore  decreased. 
Like  the  ordinary  moving  average,  exponential  smoothing  has  a  stable 
response  to  changes,  but  the  rate  of  response  can  be  readily  adjusted. 
Then,  too,  the  method  can  be  extended  to  the  calculation  of  trends, 
and  changes  in  trends,  with  very  little  extra  data-processlng. 

MOVING  AVERAGES 

Before  defining  exponential  smoothing,  let  us  recall  the  procedure 
followed  in  updating  a  moving  average.  Svppose  we  have  observed 
demands  in  the  current  time  period,  d^_^  demands  in  the  last  period, 
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d+._s>  two  months  ago,  etc.  Then  the  updated  average  demand  at  the  end 
of  the  current  period  is  given  by 

Dt  ■  5  (at  *  dt-l  *  dt-2  *  •••  * 


Vi  *  5  <dt 


where  D^_1  is  the  value  of  the  moving  average  at  the  end  of  the  last 
period.  Thus  the  updating  is  accomplished  by  adding  to  the  prior 
average  a  fraction  of  the  difference  between  the  current  observation 
and  the  observation  N  periods  old,  d^._^.  This  is  the  effect  of  "add¬ 
ing  the  newest  and  discarding  the  oldest,  then  averaging  the  result." 

In  this  technique  the  most  recent  and  the  oldest  observations 
have  the  same  influence  (weight)  on  the  updated  average.  In  fact, 
each  of  the  observations  in  the  N  periods  has  the  same  weight,  l/N. 

The  moving  average  obviomly  requires  that  the  individual  observations 
for  all  N  period.;  tv  retained  and  used  for  each  updating. 

A  method  that  could  be  used  to  avoid  the  equal  weighting  of  all 
data  regardless  of  age  is  to  use  a  weighted  moving  average.  A  sequence 
of  positive  weights,  aQ,  a^,  a^,  ...  a^,  whose  sue  Is  one,  is  arbi¬ 
trarily  selected.  The  updated  average  is  then 

t  Ot  ltd  d  t-2  if-1  t-(N-l) 

The  weights  can  be  selected  so  ac  to  give  more  consideration  to  current 
than  to  earlier  data.  This  method,  however,  involves  substantially 
more  computation  than  an  unweighted  moving  a.erage,  and  also  requires 
that  all  N  observation#  be  retained.  In  addition,  although  the  weights 


9 


are  arbitrary,  subject  only  to  the  condition  that  they  are  positive 
and  their  sum  is  unity,  N  must  be  preassigned. 

A  linear  trend  or  higher  order  model  can  be  accommodated  by  a 
least  squares  procedure  in  which  each  squared  error  is  weighted  by 
the  appropriate  . 

EXPONENTIAL  WEIGHTING 

The  Basic  Concept.  Suppose  that  we  had  stored  only  the  average 

# 

demand  computed  last  month  and  had  not  stored  the  individual  obser¬ 
vations.  Ms  month  we  have  a  new  demand  quantity  and  want  to  update 
the  average.  It  seems  logical  that  if  the  demand  this  month  is  higher 
than  the  stored  average,  we  should  increase  the  latter.  Conversely, 
if  the  number  of  demands  observed  this  month  is  smaller  than  the  aver¬ 
age  at  the  end  of  the  previous  month  we  should  decrease  it.  Further¬ 
more,  if  the  difference  is  small,  the  adjustment  should  be  small.  If 
the  demand  has  been  substantially  above  (or  below)  the  stored  average, 
the  new  estimate  should  be  Increased  (or  decreased)  by  a  sizeable  amount. 

The  exponentially -weighted  average  computation  can  be  described 
symbolically  as  follows: 

(1)  Bt  ■  Bt-i  *  "<4t  -  Bt-1>>  0<°<.l 

or  by  rearrangement  of  terms, 

(2) 

- * - 

Although  we  are  describing  exponential  weighting  in  terms  of 
demands  per  month,  the  procedure  can  be  used  to  update  any  type  of 
data  sequence  or  discrete  time  series  such  as  demands  per  1000  flying 
hours,  failures  per  100  checkouts,  Issues,  etc.  The  time  period  could 
also  be  a  day,  month,  quarter,  etc. 
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where: 

D.  =  updated  average  (prediction)  made  at  end  of 
'  current  period,  tj 

*  updated  average  at  end  of  prior  period,  t-1; 

d.  «  observation  (i.e.,  demand,  demand  rate,  etc.) 
for  the  current  period;  and 

or  ■  veighti^  or  smoothing  constant,  a  value 
between  zero  and  one. 

Repeated  application  of  (2)  to  the  most  recent  N  observations 

gives 

(3)  Dt  -  ♦  aCl-orJd^  +  or (l-mr)2*^  +  ... 

*  <y(l-0f)N"1  d^^  ♦  (l-or)^^ 

N-l 

I  (l-or)\.n  ♦  (l-ar)1^,, 

n»o 

where  la  the  prediction  at  the  end  of  period  t-N,  or  at  the  start 
of  these  H  observations.  This  value  could  also  be  considered  as  the 
Initial  estimate  for  D  prior  to  any  experience. 

The  weight  assigned  to  each  observation  is  a  constant  a  times  a 
fraction  1-or  with  exponent  equal  to  the  age  of  that  observation  — 
hence  the  terms  "exponential  weighting"  or  "exponential  smoothing." 

As  N  becomes  very  large,  l.e.,  as  we  have  a  very  large  number  of 
observations  on  which  to  base  Dt,  the  "Initial  estimate"  term  drops 
out  (l.e.,  "adequate"  actual  experience  becomes  available).  The  sum 
of  the  exponential  (literally  "geometric"  in  this  discrete  case)  weight 
approaches  one: 
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t  N~>® 


N-l 
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orL  d^)ndt.n 


n«o 


+  0  , 


v  ■> 

(5)  Sum  of  weights  =  cr  (l-or)n  *  a 


n~o 


1  -  l  1  -  «  ) 


Figure  1  shows  graphically  the  weight  assigned  to  data  t  periods 
old  for  three  values  of  a.  It  can  also  he  seen  from  Eq.  3  that  the 
total  weight  given  to  all  observations  prior  to  the  N  most  recent  ones 
Is  (l-or)N. 

It  is  obvious  from  Eqs.  1  through  3  above  that  the  "responsive- 
ness"  or  "sensitivity"  of  the  prediction  (D^)  to  current  data  (d^) 
depends  upon  the  magnitude  of  the  constant,  or.  Larger  values  of  cr 
give  additional  weight  to  the  more  recent  observations;  the  converse 
is  true  for  smaller  values.  Yet,  all  data  are  always  considered  in 
D^,  however  trivial  the  weight  may  be.  This  aspect  of  the  exponential 
weighting  procedure  actually  leads  to  drastic  simplicity  in  data  storage 
requirements.  As  can  be  seen  from  Eqs.  1  and  2,  the  only  historical 
information  needed  at  each  updating  is  the  prior  period's  prediction, 

Dt-1* 

This  data  storage  requirement  contrasts  sharply  with  the  N  period 
(N  is  often  12  or  2k  months)  unweighted  moving  aversge.  At  each  up¬ 
dating  in  this  procedure  the  oldest  observation  is  dis.rrded  and  the 
moet  recent  one  added  to  compute  the  new  average.  This  means,  of 
course,  that  the  values  for  each  of  N  observations  must  be  stored. 
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Selection  of  or.  The  rationale  behind  selecting  an  appropriate 
value  for  a  la  no  nore  complex,  and  uufortunately  no  easier  to  Justify, 
tM"  that  behind  selecting  1  for  the  pnswtiy  used  nosing  average. 

Either  case  requires  a  coerced,  sc  between  1)  promptly  reflecting  true 
changes  In  the  data  sequence,  and  2)  avoiding  excessive  response  to 
■ere  chance  fluctuations.  A  large  value  for  a  lqprovea  the  rate  of 
response  to  a  changing  pattern  In  the  data  sequence  by  giving  nore 
weight  to  recent  data.  The  saw  Is  true,  of  course,  with  a  snail  value 
of  N.  In  both  situations,  however,  the  ability  of  the  technique  to 
snooth  out  randosi  fluctuations  Is  decreased. 

The  true  optimal  value  for  H  or  a  can  never  really  be  deteralned 
for  such  a  coaplex  prediction  problea  as  encountered  In  large  ecale 
logistics  systeas.  An  extensive  test  against  past  experience,  like 
that  reported  herein,  can  Indicate  which  of  'sveral  trial  values  of  or 
would  have  been  best  for  the  data  studied.  But  one  cannot  \-  ‘"'•tain 
that  future  data  would  lead  to  the  saw  conclusion. 

One  spproech  for  establishing  test  values  of  the  saoothlng  constant 
Is  through  an  equivalence  to  traditionally  accepted  V-perlod  unweighted 
■owing  averages,  flw  data  included  In  the  latter  have  an  average  age 
equal  tot 

(6)  fcU  ♦  8  ♦  -r  1  flB)  -  Igk  * 

thing  tbs  weights  shown  in  Sq.  k ,  the  data  in  tbs  espoosntlally-velghted 
average  have  m  svsrsgs  sgs  equal  tot 


2  n 

(7)  Of(0)  ♦  or(l-Of)  (1)  ♦  «(l-or)  (2)  ♦  ...  ♦  o(l-ar)  (n)  ♦  ... 

»  *  X  »d-«)  •  • 

If  ws  now  dafine  an  exponential  weighting  procedure  as  being 
equivalent  tv  an  B-perlod  unweighted  novlng  average  I  f  the  data  have 
the  seat  average  age.,  then  by  equating  Bq.  6  with  Bq.  7,  we  get 

(8)  •  ■  ^  i  and  B  »  ^  . 

Another  naans  of  defining  equivalence  iv  tv.  equate  the  variances 

o 

of  predictions  aade  by  each  technique.  If  a  is  the  variance  of  the 
observed  data,  than  the  variance  of  the  lKperlod  aovlng  average  la 
<?k,  aaauniag  the  obaervationa  to  be  independent  and  from  the  cane 
population.  The  predictions  generated  by  exponential  snoothlng  can 
be  shown*  to  hove  variance  equal  to  «ar%2^r) .  Bquating  the  two 
variancae  gives  the  aaaw  results  as  «n  B|.  6  shove. 

mis  1  shove  sons  of  the  equivalent  values  of  B  and  or.  Ve  see 
that  s  vales  of  •  sqfsal  to  0.2U0  gives  results  equivalent  to  those 
obtained  trm  an  wm sighted  aovlng  nreraga  of  9  period  in  the  sense 
described  above.  Za  tbs  latter,  tbs  9  *>et  recent  observation*  are 
usod,  and  tbs  older  ones  are  disesrded.  In  saponsntlal  weighting,  ell 
the  observations  are  used.  As  sag  he  assn  trm  Bq.  3,  tbs  total  weight 
assigned  to  all  observations  elder  than  tbs  nost  recant  nine  is 
(1-0.20)*  ■  (.80)9  a  .107*  Batons#  of  this  difference  between  the 
two  techniques,  predictions  say  differ  sibetantldly  although  tbs 
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techniques  are  equivalent  In  tens  of  the  average  age  of  the  data  and 
the  prediction  variance. 


Table  1 

VALUES  OF  THE  WEIGHTING  CONSTANT  CORRESPONDING 
TO  AH  EQUIVALENT  MOVIES  AVERAGE 


Nuaber  of  Periods 
in  Moving  Average 

00 

Equivalent  Exponential 
Weighting  Constant 

(«) 

3.0 

0.500 

6.0 

0.266 

9.0 

0.200 

12.3 

0.150 

19.0 

0.100 

24.0 

0.000 

Linear  Trend  and  Higher  Order  Models.  Ujp  to  this  point  we  have 
been  discussing  only  the  sUplest  prediction  model,  newly,  the 
straightforward  extrapolation  of  an  updated  constant  value.  Sona¬ 
tinas  a  data  sequence  la  noire  realistically  predicted  by  a  more 
elaborate  mouel,  such  as  one  including  a  linear  or  quadratic  trend 
or  a  cycle.  We  shall  be  concerned  here  with  only  the  first  of  these. 

If  there  Is  no  trend  In  the  data  so  that  a  simple  average  at  can 
be  used  for  extrapolation,  then,  as  we  have  seen,  single  exponential 
smoothing  gives  the  estimate  a^  ■  D^.  If  there  Is  a  linear  trend  In 
the  series,  the  model  It  assumed  to  be  of  the  fora 


Vk  ■  *t 


♦  kb. 


P 


(9) 


16 


vtart 

A 

■  prediction  for  period  t**k,  k-1,  2,  ...  , 

V  ■  trend  rate  as  of  the  end  of  period  t, 
expressed  In  units  of  Increase  or 
decrease  per  period, 

a^  »  trend  value  as  of  the  end  of  period  t. 

The  prediction  of  total  denand  far  the  next  a  periods  Is 

Z  ‘  “t  *  \  • 

k-1 

The  model  In  Bq.  9  requires  updating  two  constants,  e^  and  b^.  This 
can  be  done  by  use  of  "second-order  saoothlng" .  A  second-order  smoothed 
(or  exponentially-weighted)  average  Is  simply  an  average  of  the  aver¬ 
ages,  so  to  speak.  The  computation  Is  Identical  to  that  In  Bqs.  1 
through  k  for  first  order  smoothing,  only  in  this  case  the  data  sequence 

values.  Buis  If  denotes  the 
seeand-ordar  exponentially  weighted  averags  i^-deted  at  period  t,  then 


1'  the  series  of  rather  than  d^ 


(10)  »•  •  (l-gr)**^  ♦  «Dt 

T  M 

.«s 

where  is  the  first-order  average  from  Bq.  1. 
Bstlaates  of  at  and  ht  are  glean  by 

(U)  *t  -  “t  *  Dt'  *  Dt  * 

\  -  &  (Dt  -  BV-  *  Bi  -  Bt-i  • 


*R.  0.  Brown  and  R.  F.  Mayer,  "Fundamental  Theorem  of  Exponential 
Smoothing".  Journal  of  the  Operations  Research  Society  of  America, 

Vol.  9,  Vo-  f,“Bepi.-6ci.,  0S,  pp.  67 T&T. - - 


®t-n 


I  a-)1 


t-n 
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Mote  that  both  a^  and  can  be  written  In  terns  of  the  first 
and  second-order  snoothed  values  of  the  observed  data  sequence.  Hie 
latter  then  are  the  only  values  wh'ch  need  be  stored. 

Estimates  of  a^  and  b^  can  be  derived  informally  if  one  assumes 
that  demand  follows  a  linear  model  exactly,  plotting  the  response  of 

Dj.  and  and  choosing  a^  and  so  that  the  prediction  coincides 

« 

with  the  assumed  linear  demand.  A  rigorous  proof  has  been  given  to 
show  that  the  coefficients  of  any  polynomial  model  of  degree  k  can 
be  expressed  in  terms  of  the  first  k  +  1  degrees  of  exponential  smooth¬ 
ing,  and  that  this  polynomial  minimizes  the  exponentially  weighted 
least  square  error. 

In  other  words  the  coefficients  of  the  polynomial  model  can  be 
estimated  by  a  least  squares  procedure  in  which  the  squared  errors 
are  exponentially- weighted.  Ibis  is  completely  analogous  to  the 
procedure  discussed  above  for  moving  averages,  but  here  only  k  ♦  1 
smoothed  averages  rather  than  all  R  observations  need  be  retained. 

- 9 - 

Brown  and  Hayer.op.  clt.  See  also  J.  M.  Dobble,  "A  Slsple 
Proof  of  a  Theorem  in  hpomntlal  Raoothirg,"  Journal  of  the  Operations 
Research  Boc^y  yf  Voi.  U,  Re.  3,  Ray-June,  1#5,'  pp.  461-^3 . 
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iv,  to  dmca  -  SSSBE 1 

Oils  teat  of  expoosntially-veigbted  techniques  la  essentially  a 
sequel  to  another  study  of  deaa.’vl  prediction  techniques  In  the  sense 
that  we  are  using  some  of  the  sane  data  and  procedures.  Two  different 
test  designs  are  employed  In  the  present  study.  They  Involve  differ¬ 
ent  sets  of  data  and  techniques  to  he  t-oqpared.  Those  used  In  Design 
1  are  described  In  this  and  In  Section  V.  Design  2  is  described  in 
8ectlon  VIII. 

The  data  used  In  Design  1  are  from  the  above  mentioned  study, 
vhich  focused  vpaa  a  saaple  of  B-52  parts  and  falcon  components. 

Since  a  collate  description  of  these  data  Is  given  there,  ue  shall 
Include  only  a  brief  review  here. 

The  sample  of  B-52  data  consists  of  Hl-Valu  and  Category  II  re¬ 
coverable  parts  fToa  six  major  property  classes:  Atglnt  Components, 
Airframe  Structural  Components ,  Gunnery  Garments,  Boating  fire 
Control  Opponents,  Caamunleetloos  Bquipment,  and  Aircraft  Accessories, 
fts  data,  from  two  beset,  Lorlog  and  Cattle,  cover  a  period  of  33 
months,  turn  Jamaary,  1956  through  daptadber,  1958.  RM-2811  (pp.  33- 
hO)  daeerlbaa  how  a  aanple  of  878  parte  vu  selected  from  the  original 
groqp  of  7500  part  mafeera.  All  mmmmpl  1  contains  only  parts  with  5  or 
more  ds— ado  during  the  33-uomth  eaperlenoe  period. 

Theta  spars  parts  consumption  data  art  ralated  to  a  total  of 
68,000  flying  hours  of  operation  of  169  different  B-52's.  These 
plants  lneluds  series  B,  C,  D,  B,  V.  lot  ell  spare  parts  wars  appli¬ 
cable  to  ell  series.  The  earlier  study  took  this  Into  account  along 


Vstrechan,  Brown,  and  Boughten,  op.  olt. 
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with  the  flying  hour  program  of  each  aircraft  eerlea.  We  decided 
that  the  179  (of  the  272)  parte  which  are  applicable  to  all  aerlea 
would  be  adequate  for  this  teat.  A  further  restriction  was  placed 
on  the  data  for  this  study  by  our  using  only  those  line  items  (129 
of  the  179)  which  had  some  demand  during  the  first  21  months.  Oils 
was  the  maximim  experience  period  used  far  prediction,  and  it  seemed 
pointless  to  use  any  of  these  prediction  techniques  on  the  remaining 
90,  since  these  techniques  always  predict  zero  when  based  on  zero  de¬ 
mands.  The  final  B-52  sample  for  this  study,  then,  consisted  of  129 
parts  which  were  applicable  to  all  series  and  which  had  aoue  demand 
during  the  first  21  months. 

* 

Data  for  the  27  Phlcon  components  cover  a  period  of  26  months, 
from  May,  1999  through  June,  1997*  About  30,000  missile  checkouts 
(the  program  element  used  for  prediction)  were  performed  during  this 
period.  We  used  the  23  (of  the  27)  components  which  had  some  demand 
during  the  first  14  months  —  the  maylmxm  experience  period  used  for 
prediction  in  this  oast.  AM-2611  describes  the  ffclcon  data  In  greater 
detail  than  we  do  hare. 

These  are  all  the  covenants  of  the  missile. 
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V.  BBJg  HttMCnOW  TBCMBW8  -  MBQ»  1 

This  section  outlines  the  specific  tested  applications  of  the 
general  concepts  described  earlier.  The  ten  prediction  techniques 
used  are  designed  to  compare  the  following:  1)  exponential  smooth* 
log  with  and  without  a  program  element,  with  and  without  trend;  2)  the 
effect  of  different  values  of  the  weighting  constant  a;  3)  cumulative 
average;  4)  nine-month  moving  average;  and  5)  where  appropriate,  these 
procedures  as  against  those  In  RM-2&11. 

A  preliminary  trial  run  of  the  exponentially-weighted  average 
technique  was  used  to  examine  a  wide  range  of  values  for  or.  The 
results  Indicated  that  for  our  data,  values  of  0.10  and  0.20  would 
be  most  appropriate  In  the  sense  of  yielding  reasonably  accurate,  yet 
significantly  different,  resulta.  This  finding  Is  consistent  with 
the  values  for  or  currently  being  used  by  the  Navy  and  several  Industrial 
firms. 

Techniques  1-V  are  exponentlally-wtlghted  techniques  using  as 
Inputs  demands  per  progrsn  element  —  flying  hours  for  the  B-$2  parts, 
checkouts  for  the  Falcon  coaqranents.  fbr  Technique  1  we  used  cr  «  0.10. 
9m  value  of  the  ip  dated  demand  rate  Dt  for  a  given  part  was  co^uted 
using  t  nonths  of  experience  and  Bq.  2.  Then,  asswing  that  this  part 
would  continue  to  be  demanded  at  this  seme  rate  in  the  future,  we  ob¬ 
tained  the  forecast  for  a  particular  month  by  multiplying  Dt  by  the 

## 

actual  activity  (flying  hours  or  checkouts)  for  that  month.  fbr 

# 

Although  we  refer  to  these  as  different  techniques,  they  ere 
really  variations  of  two  basic  models  —  exponential  smoothing  and 
averaging. 

**In  a  realistic  prediction  problem,  the  actual  flying  hours  for 
future  months  would  have  to  be  estimated. 
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each  experience  period,  prediction*  were  made  for  the  following 
12  months  within  the  limits  of  the  data.  Thus,  there  are  21  such 
prediction  sets  (each  consisting  of  12  monthly  predictions)  for  the 
B-52  parts  and  14  sets  for  the  Falcon  components. 

Technique  2  is  the  same  as  Technique  1  except  that  we  used 

a  ■  0.20. 

In  Technique  3,  we  assume  that  there  was  a  linear  trend  in  the 
demands  per  program  element  during  the  first  t  months  of  experience 
and  that  this  same  trend  will  continue  in  the  future.  Using  a  «  0.10, 

A  A  A 

we  compute  a^  and  b^  from  Eq.  11,  and  from  Eq.  9  for  k  =  1,  2, 

...  12.  Hie  forecast  for  a  particular  month  is  obtained  by  multiplying 

A 

the  appropriate  dt+^  by  the  activity  (flying  hours  or  checkouts)  for 
that  month.  Again  there  are  21  predictions  sets  for  the  B-52  parts 
and  l4  sets  for  the  Falcon  coajponenus. 

Technique  4  is  the  same  as  Technique  3  except  that  we  used 
or  «  0.20.  Note  that  second  order  smoothing  must  be  used  in  Techniques 
3  and  4. 

Technique  5  la  »  sl^le  unweighted  cumulative  average  or  issue- 
rate  technique  (identical  to  Technical  I  of  RM-2011) .  In  this  tech¬ 
nique,  the  total  nusber  of  dssmwds  for  a  given  part  during  t  months  of 
experience  is  divided  by  the  total  activity  (flying  hours  or  checkouts) 
during  that  period  to  give  an  average  demand  rate.  The  demand  for  a 
particular  month  In  the  future  Is  then  obtained  by  multiplying  this 
average  demand  rate  by  the  actual  activity  far  that  month,  Just  as 
with  the  other  techniques. 

Techniques  6,  7,  3  and  9  are  like  1,  2,  3  and  4  respectively. 

The  only  difference  is  that  the  Inputs  are  the  actual  monthly  demands 
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instead  of  the  demands  per  program  element.  Bence  the  and 
values  are  the  monthly  forecasts.  The  prediction  problem  is  simpli¬ 
fied  because  no  estimates  of  the  program  element  in  future  oaths  is 
needed. 

Technique  10  is  an  unweighted  nine-month  moving  average.  The 
procedure  is  like  Technique  5  except  that  Instead  of  all  the  data,  ve 
use  only  the  most  recent  9  months.  A  9-month  moving  average  was  se¬ 
lected  since  it  gives  the  same  prediction  variance  as  first  order 

exponential  smoothing  with  or  *  0.20,  and  also  equates  the  average 
* 

age  of  the  data. 

For  ease  of  reference,  ve  list  the  techniques  in  Table  2. 

- 1 - 

See  Section  III,  Eq.  8,  or  Table  1. 
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Table  2 

PREDICTION  TECHNIQUES  -  DESIGN  1 


Technique 

Number 

i 

Description  of  Technique 

Value  of 

Weight  a 

1 

Pirst-order  exponentially 
weighted  average  applied 
to  demand  rates 

0,10 

2 

First-order  exponentially 
weighted  average  applied 
to  demand  rates 

0.20 

1 

1 

3 

Exponential  weighting  with 
trend  applied  to  demand 
rates 

0.10 

4 

Exponential  weighting  with 
trend  applied  to  demand 
rates 

0.20 

5 

Unweighted  cumulative 
average  applied  to  demand 
rates 

— — 

6 

1 

First-order  exponentially 
weighted  average  applied 
to  actual  demands 

0.10 

7 

First-order  exponentially 
velghteu  average  applied 
to  actual  demands 

0.20 

e 

Exponential  weighting  with 
trend  applied  to  actual 
demands 

0.10 

i 

9 

Exponential  weighting  with 
trend  applied  to  actual 
demands 

0.20 

1 

10 

Unweighted  nine-month  moving 
average  applied  to  demand 
rates 

m 

The  miwm  of  accuracy  uatd  for  making  ccqparlaona  among  tha 
technique*  iro  th*  mm  m  thoaa  uatd  In  104-8611,  vl*. ,  tha  average 
monthly  trror  (AKS),  tht  relative  trror  (hi),  and  tht  root  Man  •quart 
trror  (BMB).  Zn  addition,  tht  average  abaolutt  trror  or  Man  abfolutt 
deviation  of  tht  monthly  prediction*  (MAD)  vat  added,  to  thla  atudy 
than  w  dlacovtrtd,  during  diicuialona  of  RM-2611,  that  intereat  in 
thla  Mtaurt  txlattd. 

* 

To  exprtaa  the  abort  ataaurts  in  symbolic  fora,  let  Dt+k  be  the 
predicted  demand  in  month  t+k  baaed  on  t  month*  of  experience.  Thua, 

A 

for  araagil  e,  In  Technique*  1  and  2,  la  D^  multiplied  by  the  ac¬ 
tivity  in  tht  (t+k)th  month,  vhereaa  in  Technique  a  6  and  7,  it  la  the 
aaat  aa  D^.  Since  ve  art  predicting  for  12  month*  in  the  future,  k 
will  take  cn  the  valuta  1,  2,  ...  12  for  a  given  t.  We  let  Dt+Jc  be 
the  actual  damaada  In  the  kth  month  following  t  month*  of  experience. 

With  thla  notation,  tha  four  aaaauraa  of  accuracy  can  be  expressed 
symbolically  aa  follows t 


12 

m  S  k* '  B***l 
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RMS  - 

There  were  21  prediction  seta  for  the  B-52  parts  and  l4  for  the 
Falcon  components  because  of  the  amount  of  data  avallaole.  We  fur¬ 
ther  restricted  the  number  of  prediction  sets  by  computing  the  error 
measures  only  after  "meaningful"  experience  had  occurred.  For  the 
B-52  parts  ve  began  with  predictions  based  on  the  first  12  months  of 
experience,  and  for  the  Falcon  components  after  8  months.  Hence  in 
the  above  formulas,  t  =  12,  13,  ...,  21  for  the  B-52  parts,  giving  10 
sets  of  error  measures.  For  the  Falcon  components,  t  -  8,  9,  ...,  1^, 
yielding  7  sets  of  error  measures. 

USIHG  THE  MEASURES  OF  ACCURACY 

The  four  measures  of  accuracy  are  summary  mi  .ores  for  each  line 
item  in  the  12 -month  period  following  each  experience  period.  Since 
the  Average  Monthly  Error  (AME)  Is  simply  the  algebraic  sum  (divided 
by  12)  of  the  prediction  errors  for  each  of  12  months,  it  can  be  con¬ 
sidered  as  a  measure  of  the  total  error  for  a  12-month  period.  That 
Is,  the  computed  AME  is  Just  one-twelfth  of  the  total  error  for  one 
year.  It  seems  to  be  the  most  appropriate  measure  for  selecting  a 
"preferred"  technique  because  the  Air  Force  is  usually  Interested  in 
predicting  requirements  over  a  period  of  several  months,  o*ten  a  pro¬ 
curement  leadtime.  Of  course,  any  particular  measure  of  accuracy  has 
its  disadvantages,  but  in  most  cases  the  technique  with  the  smallest 
AME  also  gave  the  smallest  values  for  the  other  measures.  The  pre¬ 
ferred  technique  for  each  item  was  selected  as  in  RM-2811.  In  general, 
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it  vu  the  one  vhich  yielded  the  smallest  A ME  for  the  greatest  number 
of  prediction  sets.  Modifications  of  this  procedure  were  made  when 
there  was  no  single  technique  which  satisfied  this  criterion,  as  de¬ 
scribed.  in  the  earlier  Memorandum. 

Our  objective,  of  course,  is  not  to  find  the  best  technique  for 
each  item.  Rather,  we  want  to  determine  which  technique  is  preferred 
over  a  representative  sample  of  items.  One  obvious  approach  is  to 
count  the  nuaber  of  items  for  which  each  technique  performs  best.  How¬ 
ever,  when  many  techniques  are  being  coopered  in  this  way,  it  is  unlikely 
that  one  technique  will  perform  beat  on  a  majority  of  the  items.  Lack¬ 
ing  such  a  majority,  r.  technique  should  not  be  labelled  as  the  "best" 
sinply  because  it  was  preferred  far  the  largest  number  of  items.  There 
may  be  another  technique  which,  when  cohered  with  this  "best"  one, 
would  be  selected  for  a  majority  of  the  items.  A  sufficient  test  for 
designating  a  best  technique  would  be  to  show  that  it  was  preferred 
for  a  majority  of  the  ltesm  for  each  paired  caparison  of  techniques. 
Uhfortwately,  aa  the  following  exaapla  shows,  there  may  be  no  tech¬ 
nique  with  this  property.  Suppose  there  are  three  line  Items,  1,  2, 

3,  and  three  techniques  A,  B,  C.  Let  technique  A  be  preferred  to 
technique  B  on  two  Items  and  let  technique  B  be  preferred  to  technique 
n  on  two  items.  If  prefsrenoea  ware  transitive,  technique  A  would  be 
preferred  to  technique  0.  Bowava r,  the  tabulation  below  shows  that  a 
case  can  be  devised  in  which  C  Is  prafsrrsd  to  A  on  two  parts  and 
therefore  no  technique  is  preferred  overall.  The  result  can,  of  course, 
he  generalised  to  a  larger  syetem. 

*This  is  kmewm  as  the  "parados  of  va||MM  Is  the  literature.  See, 
for  example,  X.  J.  Arrow,  Jo*in  Vi  ley 

and  Sons,  Inc.,  lew  York,  IJuTpi 


Ranking  of 
Techniques 

Line  Items 

1 

2 

3 

Best 

A 

C 

b 

Median 

B 

A 

c 

Worst 

C 

B 

A 

Section  IX  discusses  the  defects  of  this  counting  procedure  at 
greater  length  and  derives  a  better  method  for  selecting  a  preferred 
technique  applicable  to  the  lov  cost  items  of  Design  2.  Since  the 
counting  procedure  is  so  simple,  however.  It  vas  used  In  both  Design  1 


and  Design  2 


m.  mauiae  or  ng  gar  -  ataion  1 


This  ssetlon  ausmarlses  the  results  of  applying  the  10  techniques 

to  the  two  sets  of  dsts  (B-52  ports  and  falcon  components)  and  states 

* 

our  findings  and  conclusions  for  Design  1. 

Table  3  shows  the  nvasber  of  (artd  by  preferred  technique  and 
property  class  for  all  125  parts  In  the  sample,  for  the  53  parts  which 
had  no  demands  In  the  first  12  months,  and  for  the  60  arts  which  had 
at  least  10  demands  In  the  first  21  months.  The  two  sub-samples  of 
53  and  60  parts  respectively  were  Isolated  to  determine  whether  some 
techniques  are  particularly  good  on  low  (high)  demand  parts. 

From  Table  3-A  we  see  that  T»  'hniques  4,  5#  6  and  9  are  preferred 
for  about  the  sane  manber  of  parts,  as  are  1  and  3.  There  were  50 
parts  for  which  exponential  smoothing  techniques,  taking  account  of 
flying  hours  (Ros.  1-4)  were  preferred,  and  50  for  which  exponential 
soothing  techniques  without  program  clement  (Hoe.  6-9)  were  preferred. 

Me  mads  paired  comparisons  between  Technique  5,  the  Issue  rate 
technique,  and  Roe.  1,  3,  4,  6  and  9*  Many  paired  comparisons  are 
possible,  but  they  are  tedious  to  make.  Since  we  are  Interested 
primarily  la  comparing  the  current  Air  fores  procedure  with  various 
exponential  smoothing  procedures  which  seen  to  hold  sons  praml.se  of 

improvement,  we  limited  the  number  of  comparisons.  The  following 

## 

numbers  of  part-preferences  were  obtained t 

« 

The  computer  calculations  were  programed  by  D.  flopf. 

## 

The  total  for  each  comparison  Is  not  125,  the  total  number  of 
parts  In  the  sample.  This  Is  due  to  the  fact  that  for  soam  parts  It 
wee  Impossible  to  make  e  selection  based  on  the  two  techniques  being 
compared. 


B-52  PARTS  BY  Pkr 
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Hie  difference  between  the  numbers  of  parts  in  each  c caparison  la 
not  statistically  significant.  Hence  on  the  basis  of  both  criteria  — 
ranking  and  paired  comparisons,  we  conclude  that  for  this  entire  sample 
of  12?  parts  no  one  of  the  exponential  smoothing  procedures  Is  better 
than  the  Issue  rate  procedure  currently  being  vised  In  the  Air  Force. 

Table  5-B  shows  the  preferences  when  we  consider  only  the  55  parts 
which  had  no  de— nda  during  the  first  12  months.  That  exponential 
smoothing  techniques  with  trend  are  preferred  to  those  without  trend 
Is  logical.  Thus  Technique  9  la  preferred  for  the  largest  number  of 
parts,  18*  Teehalque  4  Is  preferred  for  the  next  largest  masher,  l*. 
Both  of  these  use  •  ■  .BOj  9  is  applied  to  actual  demands  and  U  to 
demand  rates. 

Table  5-C  shows  the  distribution  of  preferences  for  the  60  pert* 
with  at  least  10  demands  la  the  first  21  months.  Technique  6  has  the 
largest  number  of  preferences,  15)  Techniques  4,  5,  and  9  each  h arc 
about  tha  saee  farther*  Again  we  see  no  real  preference  for  exponential 
smoothing. 

Table  4  shows  the  number  of  components  of  the  Falcon  missile  by 
preferred  technique  and  general  characteristics.  Technique  1  was 
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5  BY  PREFERRED  TECHNIQUE 
lACTHRISTECS 
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pa»fe~red  for  the  laegpat  w&trr  ot  eanpeasats,  5,  ml  techniques  3, 
and  3  «m  each  pseterrsd  tor  4  coapon eats.  Bar*  ware  ao  prefer¬ 
ences  for  techniques  6  and  7.  Bare  aa  see,  however,  that  to  aaa  a 
progran  eleaant,  check-outs.  Is  hatter  then  not  to  use  It:  there  were 
13  preferences  for  techniques  1-4,  and  only  2  for  6-9.  Ibis  la  due  to 

the  accelerated  phase- In  of  the  Falcon  alsslle  during  the  period  In 
* 

question. 

Us  aade  paired  ccaperlsons  between  technique  3,  the  Issue-rate 
technique,  and  Boa.  1,  3,  end  4,  with  the  following  results. 


n 

Amber 
of  Parts 

5 

12 

1 

ID 

5 

12 

3 

11 

3 

16 

4 

7 

tea  dlffarenoe  betvean  the  makers  of  parts  in  sash  eoaparlaon  Is  not 
statistically  significant.  Banos,  as  In  tfaa  c aaa  of  ths  parts, 
tbsra  Is  ao  raal  prafsrsaoa  for  an  axpanaaflal  snoot  hing  tschnlqus, 
rsgardlsas  of  ahlah  orlterlcn  la  uaad  —  .taking  or  paired  eoaparlaon. 

Aatraoban,  hew,  sod  Boughten,  os.  ait.,  p.  66. 
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yin,  gga  2  —  data,  techniques,  amp  results 

The  data  used  in  Design  1  were  for  Hi-Valu  and  Category'  II  re¬ 
coverable  lteas  for  both  the  B-52  and  the  Fhlcon  missile.  Furthermore, 
the  demands  were  at  base  level.  It  seemed  desirable  to  test  expo¬ 
nential  smoothing  techniques  on  some  Category  III  Items.  Demands  for 
such  Items  are  generally  much  higher  than  for  Hi-Valu  and  Category  II -R 
parts;  there  are  many  more  Category  III  parts;  and  they  are  managed 
differently.  If  applicable,  the  automatic  computing  procedures  of 
exponential  smoothing  (with  or  without  trend)  and  decreased  data  storage 
requirements  could  be  valuable. 

Chlahoma  City  Air  Materiel  Area  (OCAMa)  had  Issue  history  on  about 
160.000  WSM* : B-52  Items  for  the  29}  months  tram  April  1 6,  i960  to  Sep¬ 
tember  30,  1962.  Data  on  a  sample  of  about  16,000  Items  were  made 
available  to  us.  9m  Information  for  each  line  Item  included,  among 
other  things,  the  mtobcr  of  requisitions  and  the  mafcer  of  Issues  on 
a  quarterly  basis,  unit  cost,  and  the  fependablll ty/Repair/ Coat  (BtC) 
Code.  Blends hie  Category  III  Items  have  WC  cods  Nl”. 

Ms  selected  a  sample  trm  the  16,000  eonslstlng  of  every  25th  item 
that  had  eomt  laauea  durine  the  flret  seven  quarters  and  flic  code  V, 
beginning  with  the  flret  lien  la  the  listing  that  satisfied  these  con¬ 
ditions.  Store  were  items  in  this  sagpie.  On  ths  grounds  that 
exponential  smoothing  would  probably  not  be  used  on  Items  with  lees 
than  one  domed  per  quarter,  me  then  eliminated  all  items  which  had 
fewer  than  10  lseues  during  the  first  seven  quarters.  Bile  reduced  our 
sample  site  to  292. 

- s - 

Weapon  Bystem  Manager  —  under  this  management  concept  nost  of  th* 
Issues  are  made  to  satisfy  routine  base  demand.  For  Items  which  ere 
peculiar  to  the  weapon  systen  there  will  he  some  lseues  to  Specialised 
Repair  Activities  (8RA). 


f 
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It  Is  of  tame  interest  to  examine  the  fluctuations  in  the  average 
issues  per  line  ltea  during  the  data -collect Ion  period,  as  shovn  in 
Thble  5. 

The  average  number  of  Issues  per  line  item  for  all  ten  quarters 
is  163.4.  For  the  first  4  quarters  it  is  148.5;  for  the  first  7  it 

is  162.0.  The  largest  average  occurs  in  the  seventh  quarter,  239.1, 

* 

and  the  smallest  in  the  first,  104.4.  There  is  no  pattern  to  these 
averages  Thus  the  average  number  of  Issues  per  month  ranged  from 


Table  5 

AVERAGE  ISSUES  PER  LINE  ITEM 
(Ten  quarters,  292  items) 


Quarter 

Average 

1 

104.4 

2 

143.9 

3 

185.5 

4 

160.2 

5 

137.7 

6 

162.9 

7 

239.1 

8 

154.1 

9 

145.9 

10 

200.3 

about  3  to  8  par  line  item.  In  our  sample  of  292,  there  occurred  51 
items  for  which  there  were  recorded  Issues  during  only  one  of  the 
first  seven  quarters.  Some  of  these  had  Issues  during  the  last  3 
quarters.  For  all  425  Items  In  the  original  ssaqple,  the  averages  are 
reduced  by  about  on? -third. 


This  may  be  due  in  part  to  the  fact  that  the  data  for  what  ve 
are  calling  the  first  quarter  really  were  for  only  2^  months.  We  feel 
that  the  effect  of  this  on  our  subsequent  work  is  negligible. 


The  most  expensive  item  In  our  Initial  sauple  of  425  coat  $159* 
There  wars  4  laauea  of  it  during  the  fourth  quarter  and  none  at  any 
other  tine.  The  next  eoat  expensive  unit  coat  $139*  Thirty-five  of 
theae  were  laaued  during  the  flrat  7  quarters  and  30  in  the  laat  3. 
There  was  one  leaue  in  the  fourth  quarter  and  none  at  any  other  tine 
for  an  ltae  which  coat  $99*  Twenty  $98.50  ltena  were  laaued  during 
the  5th  quarter  and  18  in  the  laat  3*  All  the  othe>*  ltena  coat  leas 
than  $90*  Only  the  aecond  and  fourth  of  theae  four  ltena  were  in¬ 
cluded  in  our  aaaple  of  292. 

There  were  14  of  the  cheepeat  item,  which  coat  one  cent.  laauea 
ranged  Aron  6  to  53*698  during  the  flrat  7  quarters  and  from  none  to 
18,742  in  the  laat  3  quarters.  There  were  5  of  these  items  which  had 
no  laauea  during  the  last  3  quarters.  During  the  first  7,  they  had 
402,  450,  555*  599*  and  4,005  issuas.  The  item  which  had  six  issues 
in  the  first  7  quarters  had  102  In  the  laat  three.  It  was  not  included 
in  our  SMgile  of  292. 

The  Above  again  emphasises  the  difficulties  inherent  in  demand 
prediction  due  to  the  irregularities  in  demand  patterns.  This  laat 
bears  out  the  results  of  earlier  MID  studies.* 

In  order  to  give  the  reader  soma  feeling  for  the  data,vc  have 
included  in  Mhla  6  the  unit  eoat  and  quarterly  Issues  for  every  loth 
item  in  our  sample  of  425.  It  can  be  seen  that  Issues  tr on  depot  era 
erratic.  In  fact,  the  ratio  of  variance  to  naan  la  greater  than  one 
for  nearly  all  the  parts  in  the  table,  fbr  sons  parts  it  is  greater 
than  r0,  as  for  exaaple,  nuabert  22  and  31* 

*8ee,  for  example,  Bernice  Brown,  Characteristics  ofDsnand  for 
Aircraft  Spare  Parts.  The  MID  Corporation,  1-292,  July,  1950* 
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LY  ISSUES  FOR  A  SAMPLE 
II  B-52  PARTS 
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There  were  18  property  clashes  represented  In  our  settle  of  292, 
only  four  of  which  had  at  least  10  line  Items  In  then.  We  consoli¬ 
dated  the  remaining  14  classes  In  stating  our  results.  The  following 
table  gives  the  number  of  Items  Included  in  the  property  classes  In 
our  sample: 

Ho.  of  L/I 


FEDERAL  SUPPLY  GROUP  (FSG) _  Ip  SflflnpLc 


15  —  Aircraft  and  airframe  rtructural  components . 42 

47  —  Pipe,  tubing,  hose,  and  fittings . 22 

53  —  Hardware  and  abrasives . 115 

59  —  Electrical  and  electronic  equipment  components  ...  71 
All  others . 42 


Total  292 

The  test  design  for  these  data  differed  from  the  one  employed  far 
the  B-52  and  Falcon  data.  We  used  six  techniques  and  predicted  for 
three  quarters  In  the  future.  Historical  base  periods  consisting  of 
four  quarters  of  data  and  seven  quarters  of  data  were  used.  Ho  program 
element  was  Introduced.  Tbs  techniques  are  defined  as  follows: 


Technique  Base 

»**sr _ 2K*2i 


Technique 


1  first  4  quarters 

2  first  4  quarters 

3  first  4  quarters 

4  first  7  quartsrs 

5  first  7  quarters 

6  first  T  quarters 


Issue  rets 

AqponentlaL  smoothing,  •  ■  .20 
ftqpooentlal  smoothing,  e  -  .30 
Issue  rate 

feponentlal  smoothing,  or  -  .20 
fepooential  smoothing,  a  ■  .30 


The  same  four  measures  of  accuracy  were  used  as  in  the  first 
part  of  this  study.  Selections  were  mads  independently  for  the  four- 
quarter  bass  end  the  even -quarter  bass.  Tbs  number  of  line  items  for 
which  each  technique  is  preferred  is  given  in  Wbls  1. 


*The  ini 1 1 al  estimate  for  the  exponential  smoothing  technique  is 
obtained  by  average  the  date  over  the  base  period.  (See  Iq.  30 


( 
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Sable  7 

NUMBS  OF  PARTS  BY  PREFERRED  TECHNIQUE  AND 
FEDERAL  SUPPLY  GROUP 


FSG 

Technique 

Number 
of  Line 
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Seven  Quarter  Base 
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■n 

1  222.-- 

l^ing  four  quarters  of  historical  data,  we  were  unable  to  identic 
a  preferred  technique  for  138  parts  (47  per  cent).  Even  when  we  used 
7  quarters  of  data,  74  of  the  292  parts  (25  per  cent)  Indicated  r.o 
preferred  technique. 

Technique  3  (or  »  .3)  Is  preferred  for  the  largest  number  of  parts 
based  on  4  quarters  of  data.  Yet  there  Is  no  outstanding  preference 
when  7  quarters  are  used,  Techniques  4  (issue  rate)  and  6  (o  »  .3) 
being  preferred  by  about  the  seas  nuaber. 

It  la  Interesting  to  exartlne  the  technique  preferences  for  a  line 
lt.ea  based  on  4  and  7  quarters  of  data.  Hopefully,  If  Technique  1  wer< 
preferred  for  a  part  based  on  the  first  4  quarters  of  data,  then  Tech¬ 
nique  4  should  be  preferred  based  on  the  first  7  quarters  of  history. 
The  same  should  hold  true  for  Techniques  2  and  5,  and  3  and  6.  This 
did  not  happen,  as  can  be  oeen  frost  Table  8. 


Table  8 


HUMBER  OP  PARTS  BT  PREFERRED  TECHNIQUE  BASED  OH 
4  AHD  7  QUARTERS  OP  DATA 


Technique  -  k  Quartern  y 

Technique  -  7  Quarters 
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No 

Pref¬ 
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Total 
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32 

15 

62 
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35 
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88 

No 
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51 

2 

33 

52 

138 

Total 

'.or 

10 

!  101 

1 _ 

74 

292 

There  were  only  12  parte  for  vhlch  the  Issue  rate  technique  vee 
preferred  regardless  of  the  aaount  of  date,  none  for  2  and  5,  and  35 
for  3  and  6  (exponential  —nothing,  a  ■  .3),  There  were  52  parts 
(18  per  cent)  for  vhlch  there  were  no  preferences  based  on  either  4 
or  7  quarters  of  data.  Thus  we  see  that  If  one  technique  is  preferred 
based  cn  4  quarters  of  data,  there  is  no  reason  to  suppose  that  this 
ss—  technique  would  be  preferred  as  additional  dee  and  experience 
beconee  available. 

Techniques  1,  2,  and  3  tended  to  overesti— te  as  a  grovp  and 
Techniques  4,  5,  and  6  tended  to  ucdsrestl— te  as  a  groiq>.  The 
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following  table  shown  the  number  of  parts  for  which  the  preferred 
technique  under-  and  overestimated.  Where  there  was  no  preference. 
It  was  still  possible  to  categorize  the  parts  in  this  respect. 


Table  9 


NUMBER  OF  PARTS  UNDERESTIMATED  GP 
OVERESTIMATED  BY  PREFERRED 
TECHNIQUE 
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292 

The  maber  of  parts  far  which  the  techniques,  using  the  two  bases, 
consistently  underestimated  or  overestimated  was  about  the  same,  72  and 
?6,  respectively.  For  the  totals,  the  nvsbers  of  line  Items  were  re¬ 
versed,  182  and  110,  coshered  with  106  and  186. 

Wt  did  not  use  second  order  smoothing  because  it  is  unlikely  that 
one  would  want  to  use  a  prediction  technique  with  e  trend  factor  of 
only  4  quarters  of  data,  or  even  of  7  quarters  of  date.  Furthermore, 
there  Is  usually  some  question  about  the  accuracy  of  the  Information 
at  the  outset  of  a  data  collection  program. 

We  also  examined  the  133  port*  In  our  original  saoqple  of  423  which 
had  fewer  than  10  Issues  during  the  first  7  quarters.  With  a  base  period 
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of  4  quarters  of  date,  there  vaa  no  preferred  technique  for  124  of 
then.  Of  the  reminder,  Technique  1  vae  preferred  for  8  of  the  Item 
and  Technique  3  for  1  of  then.  When  ve  used  7  quarters  of  data  to 
predict,  113  Item  exhibited  no  preference.  Technique  4  vaa  preferred 
for  6  and  Technique  6  for  14  item. 

Our  data  included  the  mnber  of  requisitions  by  quarter,  as  veil 
as  the  number  of  issues.  We  applied  our  techniques  to  predict  the 
mnber  of  requisitions  per  quarter.  Using  4  quarters  of  data,  ve 
predicted  the  mnber  of  requisitions  far  the  next  3  quarters  and 
multiplied  these  figures  by  the  mnber  of  issues  per  requisition 
during  tie  base  period  to  get  the  nunber  of  demands .  Then  ve  followed 
the  same  procedure  using  7  quarters  as  a  base,  the  results  of  the 
selection  of  preferred  techniques  were  substantially  the  tame  aa  when 
ve  did  not  uae  requisitions.  Brace  the  results  ere  not  Included  here. 


CONT 
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IX.  MEASUREMENT  OF  AGGREGATE  LOSS  USING  A  STATISTICAL 
gTOOTTHgglgflgg  APPROACH 

In  Sec .  VI  we  described  four  measures  of  error  that  were  used  to 

* 

assess  prediction  accuracy:  average  monthly  error,  average  absolute 
error,  root  mean  square  error,  and  relative  error.  Using  the  B-52 
and  Falcon  data,  we  observed  that  for  a  particular  line  item  the  pre¬ 
diction  technique  that  resulted  in  the  smallest  value  of  average  monthly 
error  usually  had  the  smallest  value  for  the  other  three  measures  of 
error  as  well.  We  selected  as  the  preferred  one  for  each  item  that 
technique  with  the  smallest  average  monthly  error  for  the  greatest 
number  of  prediction  sets.  To  determine  the  preferred  technique  over 
the  entire  saaqple  of  125  B-52  parts  and  23  Falcon  conqponents  we  simply 
counted  the  number  of  times  each  technique  was  preferred  (see  Tables  3 
and  4) .  Similar  procedures  were  applied  to  the  OCAMA  data. 

Such  a  counting  procedure  has  several  drawbacks .  In  the  first 
place,  each  item  is  weighted  equally  though  the  average  demand  and 
unit  cost  vary  widely  from  item  to  item.  Secondly,  if  no  technique 
performs  best  on  a  majority  of  the  items,  one  should  evaluate  them  by 
pairs.  If  there  are  several  techniques,  the  nvmber  of  required  com¬ 
parisons  may  be  very  large.  Still  worse  is  the  possibility  that  there 

is  no  preferred  technique,  since  the  preference  relations  are  not 

» 

transitive.  Thirdly,  the  procedure  is  insensitive  to  the  magnitude 
by  which  a  technique  is  preferred.  Ebr  exarqple,  the  counting  procedure 
will  label  as  "preferred"  a  technique  that  performs  slightly  better  than 
a  second  technique  on  the  majority  of  items  but  far  worse  on  the  balance. 

* 

See  Sec.  VI. 


We  shall  now  describe  another  measure  of  aggregate  error  suitable 

* 

far  use  on  the  OCAMA  data.  This  measure  does  not  possess  the  three 
defects  of  the  counting  procedure  noted  above.  Lince  we  are  concerned 
with  low-cost  items  that  are  managed  under  economic  order  quantity  pro- 
cedures.,  the  approximate  expression  for  total  variable  cost  (TVTC)  for 
a  line  item  during  a  time  period  is: 

(13)  TVC  =  |  1C  +  |  S  , 

where 

Q  =  economic  order  quantity 
I  «*  interest  rate  per  period 
C  =  unit  cost 
x  ■  demand  per  period 
S  ■  cost  of  placing  an  order 

Ihis  is  the  familiar  cost  expression  underlying  the  classical  Wilson 
economic  lot  size  formula.***  The  first  term  on  the  right-hand  side 
la  the  holding  cost  per  period  and  the  second  term  is  the  procurement 
cost  per  period.  By  differentiating  with  respect  to  Q  and  setting  the 
derivative  equal  to  sero,  we  obtain  the  well-known  result  for  minimum 
cost, 

(Ll0  ^optima  “  V  * 

In  Sqs.  13  and  14  we  have  assuaed  that  x,  the  true  value  of  demand 
during  the  period,  is  known.  Actually  our  problem  is  to  make  an 

- V - 

This  procedure  was  suggested  by  G  J.  Feeney. 

## 

We  are  assuming  x  and  Q  are  continuous  variables. 

See  for  exaople  T.  M.  Whltln,  The  Theory  of  Inventory  Management, 
Princeton  Ifaiversity  Press,  1957,  or  A.  R.  Ferguson  and  Lawrence  Fisher, 
Stockagc  Policies  for  Hedlia  and  Lov-Cost  Parts,  The  RAND  Corporation, 
RM-1962,  April  1950- 
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estimate  of  the  value  of  demand  which  we  shall  denote  by  if*  Uhls 
estimated  value  x  will  be  used  to  determine  Q  in  Eq,.  14.  This  value 
of  Q  is  then  substituted  into  Eq.  13  to  give  us  the  cost.  The  number 
of  procurements ,  x/Q,  and  hence  the  cost ,  will  still  depend  on  the 
true  value  of  demand,  x. 

Let  us  define  u(x,x)  as  the  cost  during  a  period  vhen  demand  is 
estimated  as  x  but  is  actually  x.  Then  froc.  Eqs.  13  and  lU, 


It  is  easily  shown  that  this  is  minimised  when  the  random  variable  x 
assunes  the  value  x. 

Let  us  define  a  loss  function,  L(£,x)  as  the  cost  when  our  estimate 
of  demand  is  x,  minus  the  coat  if  we  had  made  the  correct  decision  x  *  x. 
Then 

L(£,x)  -  loss  during  a  period  when  demand  is  estimated 
as  £  instead  of  x. 

-  u(£,x)  -  u(x,x) 

(16)  -  a-ve  .. 

Of  course,  the  true  value  x  is  not  known,  but  ve  shell  assume  that 
It  Is  distributed  according  to  a  probability  distribution  q(x) .  Our 
problem  is  to  choose  £  so  that  the  expected  value  of  the  loss  function 
is  minimized,  l.e.,  so  that 

(17)  £  (L(£,x)J  -  f  L(*,x)a(x)dx 


la  minimized. 
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Substituting  Eq.  16  into  Eq.  17  and  taking  the  partial  derivative  with 
respect  to  x  yields  the  minimizing  condition 


whence 

(18) 


In  other  words  the  loss  function  will  be  minimized  if  we  choose  an 
estimate,  x,  equal  to  the  mean  of  the  distribution  on  the  true  parameter, 
ilhua  it  is  not  necessary  to  know  anything  about  the  distribution  q(x) 
except  its  mean.  Hence,  the  exponential  smoothing  and  moving  average 
techniques  which  estimate  the  mean  are  consistent  with  this  loss  func¬ 
tion. 


In  Fig.  2  we  have  plotted  the  loss  function  of  Eq.  16  divided  by 

A 

yx  against  the  ratio  of  estimated  to  observed  demand,  assuming 
»  1.  Note  that  the  graph  is  not  synsetric.  If  we  had  plotted 
the  loss  function  against  log  the  graph  would  be  symmetric  about 

4  . 

;  -1- 


By  considering  x  to  be  a  constant  we  can  see  the  effect  of  changes 
Jn  the  ratio  Xj*.  lhat  the  value  of  L(£,x)  /-fx  is  greater  for  an 
underestimate  than  for  an  overestimate  of  the  same  amount  agrees  with 
our  intuition  of  how  the  function  should  behav  2  in  an  Inventory  system. 

If  we  over-  or  underestimate  by  the  same  relative  amounts,  the  values 
of  the  function  arn  the  sane. 

The  aggregate  measure  of  loss  for  a  technique  is  obtained  by  r imply 
computing  Eq.  16  for  each  item  and  sunmtng  over  all  items.  Not?  that  the 


(Observed  demand) 


dimensions  of  Eq.  l6  are  dollars,  and  that  consequently  this  aggregate 
loss  has  an  economic  Interpretation  vhlch  is  more  useful  than  a  measure¬ 
ment  of  aggregate  error  In  per  cent,  for  example.  Hie  v«u.ue  of  x  is 
obtained  from  the  prediction  technique,  and  the  value  of  observed  demand 


Fig.  2  —  The  loss  function  divided  by^/T 

is  entered  for  x.  We  artificially  set  £  *  1  In  those  cases  where  the  pre¬ 
diction  technique  would  have  specified  zero  to  prevent  Eq.  16  from  becoming 


Infinite.  Over  a  group  of  Items,  I  and  S  will  usually  be  considered 
constants.  Since  the  statistical  analysis  vhlch  follows  Is  not  affected 
by  these  values*  ve  assumed  that  V?-i- 

Pbr  the  entire  sample  of  425  line  Items,  the  aggregate  loss/item 
during  the  prediction  period  under  each  technique  Is  given  in  the 
following  tables: 


Four  Quarter  Base 


Technique 

Aggregate 

Loss/item 

1 

$  9.22 

2 

9.18 

3 

9.05 

Seven  Quarter  Base 


Aggregate 

Loss/Item 

4 

$  4.88 

5 

4.58 

6 

4.46 

We  can  also  think  of  the  entries  In  the  second  column  in  each  table 
as  estimates  of  the  average  dollar  loss /item  (ass  vising  ~y^|  -  l)  per 

leadtlne  period  far  Increased  costs  of  procurement  and  holding  due  to 

*» 

incorrect  demand  forecasts. 

We  cannot  compare  Techniques  1,  2,  and  3  at  a  group  with  Techniques 
4,  5,  and  6,  because  of  the  difference  In  the  base  and  prediction  periods. 


- * -  /ts 

One  reasonable  set  of  values  satisfying  y-^  »  1  is  to  choose 

I  -  .10  per  period  and  8  ■  $20  per  order.  In  thll  case  the  period  is 
3  quarters  so  that  the  yearly  interest  rate  would  be  (4/3)  .10  ■  .13. 
Studies  performed  by  M.I.T.  for  the  Army  Ordnance  Corps  indicate  that 
yearly  Interest  rates  of  .1?  and  depot  order  costs  of  $100  are  reason¬ 
able  In  that  application.  Ubder  these  assumptions,  the  value  of 

m- 2.53. 

We  ured  the  sign  test,  t-test,  and  Wllcoxon  test  to  determine 
whether  the  results  were  statistically  significant.  These  tests  are 
not  affected  when  the  variable  Is  multiplied  by  a  constant,  in  this  case 

ff- 

It  Is  perhaps  of  some  interest  to  note  that  during  quarters  5*  6, 
and  7  for  which  the  first  three  techniques  predict,  the  dollar  value  of 
Issues/line  Item  was  $161.43;  during  quarters  8,  9,  and  10  for  which  the 
last  three  techniques  predict,  the  dollar  value  of  lssues/llne  Item  was 


49 


It  Is  admissible,  however,  to  compare  these  two  groups  of  techniques 
vi thin  themselves.  The  application  of  statistical  tests  Indicated 
that  there  vere  no  significant  differences  among  1,  2,  and  3  or  among 
4,  5,  and  6  using  the  entire  sanple  of  425  items. 

We  also  applied  the  above  procedures  to  the  reduced  saople  of  292 
items  with  at  least  ten  demands  in  the  f.rst  seven  quarters.  The  re¬ 
sults  vere  the  same. 

As  a  final  test  we  predicted  the  dei  and  for  the  last  three  quarters 
based  on  the  preceding  four  quarters  of  data.  In  other  words  we  used 
Techniques  1,  2,  and  3,  but  with  quarters  4-7  Instead  of  1-4  as  a  base. 
This  enabled  us  to  coqpare  the  aggregate  loss  based  on  four  quarters 
with  the  aggregate  loss  based  on  seven  quarters  (using  Techniques  4, 

5>  and  6),  since  the  period  being  predicted  was  the  same.  The  aggre¬ 
gate  lose/item  vas  found  to  be  $4.96,  $4.66,  and  $4.79  to  correspond 
with  techniques  4,  5,  6,  respectively,  in  the  table  above,  tfe  note 
that  the  use  of  three  additional  quarters  of  data  on  which  to  base 
predictions  decreases  the  aggregate  loss /item.  These  decreases  are  not 
statistically  significant.  However,  ve  are  led  to  the  speculation  that 
data  which  are  more  than  a  couple  of  years  old  may  have  negligible  value 
for  prediction  purposes.  More  precisely,  it  appears  likely  that  the 
information,  if  any,  provided  by  data  older  than,  say,  two  years  is 
related  primarily  to  the  non-statlonary  characteristics  of  the  demand 
distribution. 

In  conclusion,  ve  should  remind  the  reader  that  the  loss  function 
discussed  In  this  section  considers  only  procurement  and  holding  costs. 
We  realize  that  stockout  costs,  which  ve  have  omitted,  are  extremely 
important,  but  they  are  difficult  to  assess  objectively.  How  much  does 
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a  stockout  cost?  Is  a  stockout  on  a  $  .01  Item  as  costly  as  a  stock¬ 
out  on  a  $30.00  Item?  Are  ten  stockouts  on  an  item  ten  times  as  costly 
as  one  stockout? 

The  advantage  of  avoiding  arbitrary  assumptions  about  stockout 
costs  Is  that  the  loss  function  In  Eq.  l6  has  only  two  parameters,  I 
and  S,  which  are  constant  over  all  the  items.  We  can  make  reasonable 
estimates  of  these  parameters.  Further,  since  they  are  constant  for 
all  Items,  they  do  not  affect  tests  of  statistical  significance  based 
on  the  loss  functions.  Finally,  it  is  important  to  keep  in  mind  that 
the  aggregate  loss  function  is  being  used  to  evaluate  prediction  tech¬ 
niques.  We  are  not  constructing  an  inventory  policy.  If  ve  were,  we 
should  be  obliged  to  consider  stockouts. 
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X.  FINDINGS  AND  CONCLUSIONS 


Exponential  smoothing  Coes  not  appear  to  be  a  sign!  flcantly  better 
predictor  than  the  cumulative  Issue  rate  techniques  currently  being  used. 
The  ranking  procedure  used  to  evaluate  both  designs  cLd  not  enable  us  to 
pick  a  preferred  technique.  When  we  applied  the  more  sensitive  test  of 
aggregate  loss  in  Design  2  for  the  Category  III  data,  there  were  still 
no  statistically  significant  differences  between  techniques. 

We  remind  the  reader,  however,  that  exponential  smoothing  has 
definite  computational  advantages.  For  first  order  exponential  smooth¬ 
ing  only  one  average  need  be  stored  for  each  item  —  this  in  contrast 
with  the  requirements  of  a  cumulative  issue  rate  or  a  moving  average. 

A  trend  can  be  readily  accommodated  with  exponential  smoothing,  and 
the  rate  of  response  due  to  the  smoothing  constant  can  be  easily  changed. 

A  measurement  of  aggregate  loss  seems  to  be  of  fundament*  ^  Impor¬ 
tance  In  assessing  prediction  accuracy.  Some  readers  may  complain  about 
a  sophisticated  measurement  of  error  such  as  the  aggregate  loss  function 
developed  In  this  Memorandum  using  a  statistical  decision  theory  point 
of  view.  Obviously  it  Is  based  on  a  simple  model  which  balances  pro¬ 
curement  costs  ageing  holding  costs.  It  is  certainly  not  a  compre¬ 
hensive  model.  On  tt  other  hand  it  is  clear  that  simple  ranking 
procedures  are  highly  questionable  and  furthermore  that  they  are  not 
sufficiently  sensitive.  Ranking  procedures  ignore  magnitude  infor¬ 
mation,  behaving  like  a  sign  test  In  classical  statistics.  We  feel 
that  future  enplrlcal  tests  of  prediction  techniques  will  Inevitably 
fall  unless  sensitive  measuring  instruments  such  as  aggregate  loss 
functions  are  employed.  Such  functions  are  less  arbitrary  and  logically 
more  appropriate. 
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Program  element  data  are  valuable  for  prediction.  This  conclusion 
Is  based  on  the  analysis  of  the  Falcon  data  in  Design  1.  a  sdlction 
accuracy  was  substantially  improved  for  19  of  23  parts  by  the  inclusion 
of  a  program  element  (checkouts).  Of  course,  the  use  of  a  program  ele¬ 
ment  requires  that  it  be  forecasted  so  that  predicted  demand  per  program 
element  can  be  converted  to  predicted  demand.  Naturally  the  Importance 
of  a  program  element  Is  determined  by  the  rate  at  which  a  weapon  16 
phased  in. 

No  program  element  information  was  available  for  the  depot  issues 
of  Category  III  items  in  Design  2. 

The  use  of  requisition  data  did  not  alter  .die  accuracy  of  demand 
prediction.  Fbr  the  Category  III  depot  issues  of  Design  2  we  had 
quarterly  data  by  item  giving  total  requisitions  and  total  Issues. 

When  the  techniques  of  Design  2  ware  applied  to  requislt-lona  for  pre¬ 
diction  end  then  multiplied  by  the  average  issues  per  requisition 
counted  over  the  base  period,  the  resulting  predictions  were  sub¬ 
stantially  unchanged.  Of  course,  there  is  an  unlimited  number  of  ways 
that  the  requisition  data  could  have  b»en  used.  Fbr  Instance,  we  might 
have  applied  the  techniques  to  Issues  per  requisition,  but  this  would 
require  an  estimate  of  requisitions  in  the  future  by  item.  Such  a 
procedure  would  be  similar  to  using  a  program  element  except  that  it 
would  necessitate  a  different  program  element  for  each  item.  Since 
this  does  not  seem  feasible,  we  restricted  our  attention  to  the  one 
application  of  the  requisition  date  described  above.  Our  conclusion 
that  requisition  data  did  not  alter  the  accuracy  of  prediction  is  baaed 
on  this  application.  However,  we  do  not  exclude  the  possibility  that  a 
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reasonable  procedure  may  be  devised  that  will  be  able  to  extract 
Information  from  the  requisition  data  for  prediction  purposes. 

Pie  accuracy  of  first  order  prediction  does  not  increase  sub¬ 
stantially  when  the  base  period  becomes  longer  than  a  year.  35iis 
conclusion  is  based  on  the  depot  issues  for  Category  III  items  in 
which  the  aggregate  loss/item  was  decreased  by  a  maximum  of  7  per  cent 
(on  exponential  smoothing  with  a  constant  of  .30)  when  the  base  period 
was  extended  from  four  quarters  to  seven.  Trend  calcinations  (second- 
order)  were  not  made  because  of  tne  paucity  of  data.  Our  conclusion 
suggests  that  the  information,  if  any,  in  data  more  than  a  couple  of 
years  old  is  primarily  related  to  trend. 

The  variance  In  depot  issues  Is  extremely  high.  If  demands  for 
an  item  from  the  depot  were  placed  in  a  random  manner,  statistical 
theory  predicts  that  we  would  observe  a  variance  to  mean  ratio  of  one 
in  the  demand  pattern.  The  variance  to  mean  ratio#  ti at  vs  observed 
in  the  Category  III  depot  data  were  almont  always  greater  than  one, 
and  often  aa  large  as  50  or  100.  Actually  we  know  that  demands  on  the 
depot  do  not  occur  at  random  by  design.  Bases  order  large  quantities 
at  Infrequent  Intervals  according  to  an  economic.  l:>t-slse  type  of 
criterion  that  sttaqpts  to  balance  the  costa  of  procurement  with  the 
costs  of  holding.  This  artificially  amplifies  the  fluctuations  of 
demand  that  art  made  **'  the  depot.  Very  little  empirical  work  has  been 
done  for  multi  -echelon  demand  problems ,  but  it  Is  obvious  that  an  inven¬ 
tory  system  designed  to  optimise  base  performance  only  may  be  decidedly 
non-optlmuB  on  a  system  basis. 
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